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Abstract 

We study the limit law of a vector made up of normalized sums of functions of long-range depen- 
dent stationary Gaussian series. Depending on the memory parameter of the Gaussian series and on the 
Hermite ranks of the functions, the resulting limit law may be (a) a multivariate Gaussian process involv- 
ing dependent Brownian motion marginals, or (b) a multivariate process involving dependent Hermite 
processes as marginals, or (c) a combination. We treat cases (a), (b) in general and case (c) when the 
Hermite components involve ranks 1 and 2. To obtain the results, we extend an asymptotic independence 
theorem of Nourdin and Rosinski [14] to Wiener-Ito integral vectors. We include a conjecture about case 
(c) when the Hermite ranks are arbitrary. 



1 Introduction 

A stationary time series displays long-range dependence if its auto-covariance decays slowly or if its spectral 
density diverges around the zero frequency. When there is long-range dependence, the asymptotic limits 
of various estimators are often either Brownian Motion or a Hermite process. The most common Hermite 
processes are fractional Brownian motion (Hermite process of order 1) and the Rosenblatt process (Hermite 
process of order 2), but there are Hermite processes of any order. Fractional Brownian motion is the only 
Gaussian Hermite process. 

Most existing limit theorems involve univariate convergence, that is, convergence to a single limit process 
([3, 5, 22]). In time series analysis, however, one often needs joint convergence, that is, convergence to a 
vector of processes. See, for example, [10, 20]. We establish a number of such results, and conclude with a 
conjecture. 

Our setup is as follows. Suppose {A„} is a stationary Gaussian series with mean 0, variance 1 and 
regularly varying auto-covariance 

7(n) = L(n)n 2d - 1 (1) 

where < d < 1/2, and L is a slowly varying function at infinity. This is often referred to "long-range 
dependence" (LRD) or "long memory" in the literature, and d is called the memory parameter. The higher 
d, the stronger the dependence. The slow decay (1) of j(n) yields 

oo 

= oo. 
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The case where 

oo 
n— — oc 

is often referred to "short-range dependence" (SRD) or "short memory". See [1, 6, 8] for more details about 
these notions. 

We are interested in the limit behavior of the finite-dimensional distributions (f.d.d.) of the following 
vector as N — > oo: 

/ , [Nt] \ 

Vjv(<) = ~aTW) E ( G ^ Xn) EG ^«)) > ( 2 ) 

V n=i J j=i,...,j 

where Gj, j = I,..., J are nonlinear functions, t > is the time variable, and Aj(Ny& are appropriate 
normalizations which make the variance of each component at t = 1 tend to 1. Observe that the same 
sequence {X n } is involved in each component of Vjv, in contrast to [9] who consider the case J = 2 and 
{(X n ,Y n )} is a Gaussian vector series with Cov(X m ,Y ) — > as m — > ±oo. 

Note also that convergence in f.d.d. implies that our results continue to hold if one replaces the single 
time variable t in (2) with a vector (ti, . . . , tj) which would make Vjv(ii, ■ ■ ■ ,tj) a random field. 

Depending on the memory parameter of the Gaussian series and on the Hermitc ranks of the functions 
(Hermite ranks are defined in Section 2), the resulting limit law for (2) may be: 

(a) a multivariate Gaussian process with dependent Brownian motion marginals, 

(b) or a multivariate process with dependent Hermite processes as marginals, 

(c) or a combination. 

We treat cases (a), (b) in general and case (c) when the Hermite components involve ranks 1 and 2 only. 
To address case (c), we extend a recent asymptotic independence theorem of Nourdin and Rosinski [14] to 
Wiener-Ito integral vectors. We include a conjecture about case (c) when the Hermite ranks are arbitrary. 
We also prove that the Hermite processes in the limit are dependent on each other. Thus, in particular, 
fractional Brownian motion and the Rosenblatt process in the limit are dependent processes even though 
they are uncorrelated. Although our results are formulated in terms of convergence of f.d.d. , under some 
additional assumption, they extend to weak convergence in D[0, 1] J ( J-dimensional product space where 
D[0, 1] is the space of Cadlag functions on [0, 1] with the uniform metric), as noted in Theorem 3.5 at the 
end of Section 3. 

The paper is structured as follows. We review the univariate results in Section 2. In Section 3, we state 
the corresponding multivariate results. In Section 4, we extend the results of [14] to Wiener-Ito integral 
vectors. Section 5 contains the proofs of the theorems in Section 3. 



2 Review of the univariate results 

We review first results involving (2) when J = 1 in (2). Assume that G belongs to £ 2 (</>), the set of 
square- integrable functions with respect to the standard Gaussian measure <j>. This Hilbert space L 2 ((j)) has 
a complete orthogonal basis {H m (x)} m >o, where H m is the Hermite polynomial defined as 

H mWH -irexp(^)^exp(^), 

([13], Chapter 1.4). Therefore, every function G € L 2 {4>) admits the following type of expansion: 

G = ^ g m H m , (3) 

m>0 
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where g m = (m!)" 1 f R G(x)H m (x)d<j)(x). 

Since H (x) = 1 and since we always center the series {G(X n )} by subtracting its mean in (2), we may 
always assume go = EG(X n ) = 0. The smallest index k > 1 for which ^ in the expansion (3) is called 
the Hermite rank of G. 

Since {X n } is a stationary Gaussian series, it has the following spectral representation 

X n = f e inx dW(x), (4) 
Jr 



where W is the complex Hermitian (W^A) = W(— A)) Gaussian random measure specified by EW(A)W(B) = 
F(A n B). The measure F is called the spectral distribution of {X n }, is also called the control measure of 
W, and is defined by 7 (n) = EX n X = J R e lnx dF(x) (See [11], Chapter 3.2). 
Multiple Wiener- Ito integrals ([12]) 



I m {K)= [ K(x u ...,x m )dW(x 1 )...dW(x m ) (5) 

where J Rm \K(xi, . . . , x m )\ 2 dF(xi) . . . dF(x m ) < oo, play an important role because of the following connec- 
tion between Hermite polynomials and multiple Wiener-Ito integrals ([13] Theorem 2.7.7): 



H m (X n )= I" e in ^+- +x ^dW(x 1 )...dW(x m ), 



(6) 



where the double prime " indicates that one doesn't integrate on the hyper-diagonals Xj = ±Xk, j ^ k. 
Throughout this paper, I m {.) denotes a m-tuple Wiener-Ito integral of the type in (5). 
We now recall some well-known univariate results: 

Theorem 2.1. (SRD Case.) Suppose the memory parameter d and the Hermite rank k > 1 of G satisfy 

0<d<i(l-i). 

Then 

, [Nt] 

^ ' n— 1 

where B(t) is a standard Brownian Motion, " —t' " denotes convergence in finite- dimensional distributions 
along the time variable t > 0, A(N) cx N 1 / 2 is a normalization factor such that 



lim Var 



Remark 2.1. It can indeed be shown that in the setting of Theorem 2.1, 

Var(j]G(X„)^ ~a 2 iV, (7) 

where 

oo oo 

o 2 = 9 2 m^- E ( g ) 



2—k 



Recall that the g m 's are the coefficients of the Hermite expansion of G, and 7 is the auto-covariance function 
of {X n }. 
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Remark 2.2. The condition <d< ^(1 — t) can be replaced with a weaker condition E^L-oo l7( n )l fc < 00 
or equivalcntly En=-oo Itg C 7 ^) I < OO; where 7g(^) is the auto-covariance function of {G(X n )}. See Theorem 

4.6.1 in [8]. If d = |(1 - i) but as N -> oo, E^=-iv l7( n )l fc = E-jv n_1 l i ( n )l* i =: L *( 7V ) ^ 00 is slowl y 
varying, then one still gets convergence to Brownian motion (Theorem 1' of [3]), but with the normalization 
A(N) cx N 1 / 2 L*(N). For example, if the slowly varying function in (1) is L(n) <~ c > 0, then A(7V) cx 
(iVlnA^) 1 / 2 . 

The original proof of Theorem 2.1 ([3]) was done by a method of moments using the so-called diagram 
formulas ([16]) which provide explicit ways to compute the cumulants of Hermite polynomials of Gaussian 
random variable. Recently, a remarkable technique for establishing central limit theorems of multiple Wiener- 
Ito integral was found by [15, 17], whereby in the multiple Wiener- Ito integral setting, convergence of 
the fourth moment, or some equivalent easier-to-check condition, implies directly the Gaussian limit. See 
Theorem 7.2.4 in [13] for a proof in the case t = 1. 

Theorem 2.2. (LRD Case.) Suppose that the memory parameter d and the Hermite rank k > 1 of G 
satisfy 

1/ 1 N , 1 
2^-k )<d< 2- 

Then 

1 [Nt] 

^Y,G{X n ) f ^ Zf\t) :=7 fe (/g), 

^ ' n=l 

where the control measure of Ifc(.) is Lebesgue, A(N) cx N 1+ ( d ~ 1 / 2 ' >k L(N) k / 2 is a normalization such that 



71=1 



and 



/$(*!, ...,**) = h /^l^l^ lx^ ...\ Xk \ 



where 

bk.d = 



{k{d - 1/2) + 1) (2k(d - 1/2) + 1) 
fc! (2r(l - 2d)sin(d7r)) fc 



1/2 



is the normalization constant to guarantee unit variance for Z( fe )(l). 

For a proof, sec [5] and [19]. The process zjf\t) appearing in the limit is called a Hermite process. 
Remark 2.3. It can indeed be shown that in the setting of Theorem 2.2, 



Var V G(X n ) = L G (N)N 2d ° +1 (9) 




for some slowly varying function Lq{N) cx L(N) k and da = (d— l/2)k + 1/2. Since d < 1/2, increasing the 
Hermite rank k decreases the memory parameter da, hence decreases the dependence. Note that if k > 2, 
then the variance growth of {G(X n )} in (9) is slower than the variance growth of {X n } : Var(^^ =1 X n ) = 
L (N)N 2d+1 for some slowly varying function L , but is always faster than the variance growth a 2 N in the 
SRD case in (7). 

The process Z^\t), t > is a Gaussian process called fractional Brownian motion, and Z^\t), t > is 

a non-Gaussian process called Rosenblatt process. The Hermite processes zf^ (t) are all so-called self-similar 
processes ([7]). 
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3 Multivariate convergence results 



Our aim is to study the limit of (2), and in particular, to extend Theorem 2.1 (SRD) and Theorem 2.2 
(LRD) to a multivariate setting. 

Suppose that for each j — 1, . . . , J, the function the functions Gj in (2) belongs to I? (</>), has Hermite 
rank kj and admits Hermite expansion J2m=k j 9m,jH m (sec (3)). 

We start with the pure SRD case where every component {Gj(X n )} of Vjv(t) in (2) is SRD. 

Theorem 3.1. (Pure SRD Case.) If the memory parameter d is small enough so that all {Gj(X n )},j = 
1, . . . , J are SRD, that is, 

d< 2 ( - 1 ~k~^ •? = 1 '---> J > 



then in (2) 

as N — > oo, where the normalization Aj(N) cx N 1/>2 is such that for j = 1, . . . , J, 



V N (t) f ^4-B(t) 



lim Var 



(10) 



Here B(t) = (-Bi(t), . . . ,Bj(t)) is a multivariate Gaussian process with standard Brownian motions as 
marginals, and where the cross- covariance between two components is 



Cav {BiMBj^ti)) = Jim Cov^^i), V N , h (t 2 )) 



(h a t 2 ) 



a 0i a 32 m=kjiVk . 2 



E 9m,h9m,j 2 m\ ^2 7(n) r 



where 



°i = E E 7(»r- 



(ii) 



(12) 



m—kj 



This theorem is proved in Section 5.1. 
Example. Assume that the auto-covariance function 7(n) ~ n 2d ~ x as n — > oo. Let J = 2, Gi(a;) = aH2(x) 



bHs(x) — bx + ax — 3bx — a, G2(x) — cH^(x) 



cx 



Sex and < d < 1/4 , then in (12), a[ = 



2« 2 E« 7(") 2 + 66 2 £~ 7(n) 3 , <x 2 = 6c 2 £~ 7W 3 , and 



' 1 [JV*] , [Nt] \ 

^ £(X 2 - 1), J2( X " 3X «) ^ (^^W' ' 

n— 1 n— 1 / 



where the Brownian motions B\ and B 2 have the covariance structure: 

h A i 2 



Cov(Bi(ti),B 2 (t 2 )) =66- 



£71(72 



E ^) 3 - 



i?i and B 2 are independent when 6 = 0. 

Next we consider the case where every component {Gj(X n )} of Vjv(i) in (2) is LRD. 

Theorem 3.2. (Pure LRD Case.) If the memory parameter d is large enough so that all Gj(X n ),j = 
1, . . . , J are LRD, that is, 



5 



then in (2) 

V N (t) ^ Zj(t) := (/ fcl (0,...,/ fcj (0), (13) 
w/iere £/ie normalization Aj(N) oc N 1 ^ -1 / 2 ^* L(N) k i / 2 j s SMC /j £/j a £ for j = 1, . . . , J, 



^limVai ! > (V,;.V,.) j = I . (14) 

i?ac/i component of Z^(t) := ^Z^ fel ^(f), . . . , Z^ J \t)^ is a standard Hermite process, and I k {.) denotes It- 
tuple Wiener-Ito integral with respect to a common complex Hermitian Gaussian random measure W with 
Lebesgue control measure, and 

it(x 1 + ...+x k ) _ ^ 

...,x k ) = b k , d i{xi+ _ +Xk) \xi\- d • • • \x k \~ d , (15) 

where b k ,d's are the same normalization constants as in Theorem 2.2. 
This theorem is proved in section 5.2. 

Example. Assume that auto-covariance function 7(71) <~ n 2d ~ x asn-> 00. Let J = 2, G\{x) — H\(x) = x, 
G 2 (x) = H 2 (x) = x 2 - 1, 1/4 < d < 1/2, then 

/ 1 W] 1 [Nt] \ 1 ^ 1 . 

I ] v T75+lE X «'^E( X ™- 1 ) I (d(2rf+l)^ 1)(t) 'rf(4d-l)^ 2)W j ' 

where the standard fractional Brownian motion Z d x \t) and standard Rosenblatt process Z d 2 \t) share the 
same integrator in the Wiener-Ito integral representation. Observe that the components Z^p and Z^p arc 
uncorrelated but dependent. 

In Theorem 3.2, the marginal Hermite processes Z d kl \t) = I kl (f^ d ), . . . , Z d kj \t) = I kj (f k j d) are 
dependent on each other. To prove this, we use a different representation of the Hermite process, namely, 
the positive half-axis representation given in [19]. 

Proposition 3.1. The marginal Hermite processes Z d kl \ . . . , Z d kj ^ involved in Theorem 3.2 are dependent. 

Proof. From [23], we have the following criterion for the independence of multiple Wiener-Ito integrals: 
suppose symmetric g\ € L 2 (M? + ) and g 2 € L 2 (M^). . Then I p (gi) and I q {g 2 ) (p,q > 1) arc independent if 
and only if 



9i ®i 92 



:= / gi(xi, . . . ,Xp- 1 ,u)g 2 (x p , . . . ,x p+q - 2 ,u)du = in L 2 (R^~ q 2 ). 

JWL + 



We shall apply this criterion to the positive half-axis integral representation of Hermite processes ([19]): 



Z d k) (t) = c k , d I k (^ t \x 1 ,...,x k )) :=c M f f flxj^l-sx^ds 



dB(xi) . . . dB(x k ), 



where B is Brownian motion, the prime indicates the exclusion of diagonal Xj — ^k->3 

^ k and c k ,d is some 

normalization constant, one could see that (let t = 1 and g kl d '■= gp f° r simplicity) for all (x\, . . . , x p+q - 2 ) e 



2 

+ 



(g P ,d ®i g q ,d)(xi,. . .,x p+q - 2 ) 

,1 p-i -1 p+9-2 



= / [f TT xj d (l - sxj^u^il - su^ds [ TT xj d (l - sx^u-^l - su) d - l ds }du>0 
Jr + \Jo j=1 Jo J=p j 

because every term involved in the integrand is positive. □ 
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Theorem 3.1 and Theorem 3.2 describe the convergence of Vjv(£) in (2) when the {Gj(X n )}, j — 1, . . . , J 
are all purely SRD or purely LRD. However, when the components in Vat(£) are mixed, that is, some of 
them are SRD and some of them are LRD, it is not immediately clear what the limit behavior is and also 
what the inter-dependence structure between the SRD and LRD limit components is. We show that the 
SRD part and LRD part are asymptotically independent so that one could join the limits of Theorem 3.1 
and Theorem 3.2 together, in the case when the G/s in the LRD part only involve the 2 lowest Hermitc 
ranks, namely, k = 1 or k = 2. This is stated in the next theorem where the letter "S" refers to the SRD 
part and "L" to the LRD part. 

Theorem 3.3. (Special SRD and LRD Mixed Case.) Separate the SRD and LRD parts ofV N (t) in 
(2), that is, letV N (t) = (S N (t),L N (t)), where 

1 [Nt] 1 [Nt] \ 

Al g -(]v) £ G ^X n ), ■ • ■ ' Ajs s{N) £ GjsAXn) , (16) 




1 [Nt] 1 [Nt] \ 

Al j~(N) £ G ^ X ^ • ■ • ' A j L L (N) £ Gj ^ X ^ ' ^ 

' x ' n=l L " x ' n=l I 

where Gj.s has Hermite rank &j,s, and G^l has Hermite rank fcj,L, A/,s oc N 1 / 2 and 

Aj t L oc iV 1+ ( d ~ 1 / 2 ) fe 3' L L(7V)' c 3' i / 2 are correct normalization factors such that for j = 1, ...,Jg and j = 
1,...,Jl respectively, 

In addition, 



l(l--r^—)<d< J(l-r^) ybro//j s = l,...,^s, jl = 1,...,Jl, (19) 

where we allow arbitrary values for kj t s but only kj t L = 1 or 2. f Condition (19) makes all {Gj t s{X n )} SRD 
and all {G jiL {X n )} LRD.) 
Then we have 

(S N (t),-L N (t)) f ^4- (B(t),Z< kl) (t)), (20) 

where the multivariate Gaussian process B(t) is given m and the multivariate standard Hermite process 
7^ L \t) is given in (3.2). Moreover, B(i) and Z^ L \t) are independent. 

This theorem is proved in Section 5.3. Observe that while B(i) is made up of correlated Brownian 
motions, it follows from Theorem 3.3 that if ztt°\t) contains fractional Brownian motion as a component, 
then that Gaussian process will be independent of any Brownian motion component of B(t). 

We conjecture the following: 

Conjecture 3.4. Theorem 3.3 holds without the restriction that kj.L be 1 or 2. 

Example. Assume that the auto-covariance function 7(71) <~ n 2d_1 as n — > 00. Let J = 2, G\{x) = H 2 (x) = 
x 2 -I, G 2 (x) = H 3 (x) =x 3 - 3x, 1/4 < d < 1/3, then a 2 = 6£^ = _ oo7 (n) 3 and 



/ x [Nt] 1 [Nt] ^ 

Jpd £( X » _ J2( X n ~ SX n) 

\ n—1 n—1 



f.d.d. 



y d{Ad-l) 

where the standard Rosenblatt process Z y d '(t) and the standard Brownian motion B(t) are independent. 
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The proof of Theorem 3.3 is based on an extension to a multivariate framework of a recent result in [14] 
which characterizes the asymptotic independence of series of multiple Wiener-Ito integrals. This, however, 
requires moment-determinancy of the limit, which we know holds when the Hcrmitc rank k — 1,2, that is, 
in the Gaussian and Rosenblatt cases. If some other Hermite distribution (marginal distribution of Hcrmitc 
process) Z^p (k > 3) is moment-determinate, then we will allow kj t L — k in Theorem 3.3. So to this end, 
the moment-problem of general Hermite distributions is of great interest. 

Remark 3.2. As mentioned in Remark 2.2, the border case dj = |(1 — tM often leads to convergence to 
Brownian motion as well. In fact, Theorem 3.1 and Theorem 3.3 continue to hold if we extend the definition 
of SRD to the case whenever the limit is Brownian motion regardless of the normalization. 

In Theorem 3.1, Theorem 3.2 and Theorem 3.3 we stated the results only in terms of convergence in 
finite-dimensional distributions, but in fact they hold under weak convergence in Z)[0,1] J (J-dimensional 
product space where D[0, 1] is the space of Cadlag functions on [0, 1] with the uniform metric). If one can 
check that every component of V N (t) is tight, then the vector Vjv(t) is tight: 

Lemma 3.3. Univariate tightness in D[0,1] implies multivariate tightness in D[0,1] J . 

Proof. Suppose every component -Xj,jv (a- random element in S — D[0,1] with uniform metric d) of the 
J-dimensional random element Xat is tight, that is, given any e > 0, there exists a compact set Kj in D[0, 1], 
so that for all N large enough: 

P {X jtN eK c )<e 

where Kj denotes the complement of Kj. If K = K\ x . . . x Kj, then K is compact in the product space 
S J . We can associate S J with any compatible metric, e.g., for X, Y g S J , 

d m (X,Y) := max (d(X 1 ,Y 1 ),...,d(Xj,Y J )). 

1<3<J 

The sequence Xa? is tight on D[0, 1] J since 

J 

P (X N g K c ) = P(U/ =1 {X J - N e K]}) < ]T P(X jtN g Kj) < Je. 

□ 

The univariate tightness is shown in [22] for the LRD case. The tightness for the SRD case was considered 
in [4] p. 328 and holds under the following additional assumption, that {G(X n )} is SRD, with 

oo 

£3 fc / 2 (fc!) 1/2 |0fcl<°°> ( 21 ) 
k=i 

where gk is the fc-th coefficient of Hermite expansion (3) of G. Observe that (21) is a strengthening of the 
basic condition: E[G(Xq) 2 } — X^fe=i k\g\ < oo. Hence we have: 

Theorem 3.5. Suppose that condition (21) holds for the short-range dependent components. Then the 
convergence in Theorem 3.1, Theorem 3.2 and Theorem 3.3 holds as weak convergence in D[0,1] J . 

Condition (21) is satisfied in the important special case where G is a polynomial of finite order. 

4 Asymptotic independence of multiple Wiener-Ito integral Vec- 
tors 

In this section, we introduce the extension of [14] needed to prove Theorem 3.3. 
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First, some preliminaries. Let ||.|| denote the L 2 norm in the appropriate dimension and let < .,. > 
denote the corresponding inner product. 

The contraction ® r between two symmetric square integrable functions / and g is defined as 

(/ ®r g){xi,. . . , x p - r ,yi, y q - r ) := 

/ f(xi, ■ ■ ■ , Xp- r , s 1 ,...,s r )g(yi,..., y q - s , Si , . . . , s r )dsi . . . ds r 

If r = 0, the contraction is just the tensor product: 

/ Oo 9 = f ® g := f(xi, x p )g(yi, . . . , y q ). (22) 

The symmetrized contraction <E) r involves one more step, namely, the symmetrization of the function 
obtained from the contraction. This is done by summing over all permutations of the variables and di- 
viding by the number of permutations. Note that as the contraction is only defined for symmetric func- 
tions, replacing ® r with <g> r enables one to consider a sequence of symmetrized contractions of the form 

(■■•((/l^n^rjs).--)®^/,. • 

We will use the following product formula (Proposition 6.4.1 of [16]) for multiple Wiener-Ito integrals 

p/xq { \ { \ 

WK g (<?) = E H (r)(r) W2r(/®rff) P,Q>0- (23) 

Because the symmetrization of the integrand doesn't change the multiple Wiener-Ito integral, ® r could be 
replaced with ® r in the product formula. 

For a vector q = (q\,. . . , qk) 1 we denote |q| := q\ + . . . + qu- By a suitable iteration of (23), we have the 
following multiple product formula: 

fe 

l[l qi (fi)= E a(q,M)J|q|-2|r| (■••(/l®r 1 /2)...®r>_ 1 /k). ( 24 ) 

where q G N™, the index set C(q, fc) = {r e Ut=i{°> h---, Qi+i] ■ n < qi, n < (gi + . . . + ft) - 2(n + . . . + 
Ti-i), i = 2, . . . k — 1}, and a(q, fc, r) is some integer factor. 

In order to extend Theorem 4.5 of [14] to the multivariate case, we need to first extend some preliminary 
results in [14]. The first extension is: 

Theorem 4.1. (Asymptotic Independence of Multiple Wiener-Ito Integral Vectors.) Suppose we 
have the joint convergence 

(Ui, JV ,...,Uj, JV )4(Ui,...,u J ), 

where 
Assume 

J im ll/»i,ji,iv Or /ii,j 2 ,Jv|| = (25) 

AT— >oo 



for all ii,i 2 ,ji ¥= h, and r = 1, . . ..^j, A ft 2j2 . 

Then using the notation u k = w* 1 . . . , we have 

EfU^ 1 ...U kj ] =E[U5 C1 ]...E[U^ J ] (26) 

for all kj e N /j ' 

Moreover, if every component of every TJj is moment-determinate, then Ui, . . . , Uj are independent. 
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Proof. The proof of (4.1) is a slight extension of that of Theorem 3.1 in [14]. The index i = 1, . . . ,Ij refers 
to the components within the vector TJj.N, j — 1, . . • , J. For notational simplicity, we let Ij = /, that is, 
each Uj,at has the same number of components. We only sketch the proof leaving out some details to [14]. 
Let |k| denote the sum of its components k\ + . . . + k m . First as in [14], to show (26), it suffices to show 

./ 

lim En(U^-E[U^])=0 

for any |ki | > 0, . . . , |kj | > 0. Note that = U^f N . . . Uj'fa is a scalar. 

By (24) , one gets 

W) k = Y fl (^ fc > r )4 g -2|r| (.■.(/®r 1 /).-.®r»_ 1 /) 

where a(q, fc,r)'s are integer factors which don't play an important role, and the index set C q ^ is as given 
in [14] (3.24). If = n^i W/*J.") fciJ . then 
i 

U -MV = II Y a (li,j,hj^ r ) I k i , j g i , j -2\r\ (• • • (fi,j,N® ri fi,j,N) ■ ■ ■ ^r^^fij,^ 

i=irec 5i ., feii . 

I 

Y Y n a ^' fc ^'' I ' l ) 7fe M9i,i-2|r i |( /l i,j,Jv) (27) 

rl e C «i,j,*i,j r'ec qi j , kl j i=l 

where 

If one applies the product formula (24) to the product in (27), one gets that U - jy involves terms of the 
form 7| p |_2| sj |(-ffj,jv) (Pj and Sj run through some suitable index sets), where 

— (• • • {hl,j,N® Sl h2,j,N) ■ ■ ■®si- 1 hl,j 1 N) ■ 

Since the expectation of a Wiener-Ito integral of positive order is while a Wiener-Ito integral of zero order 
is a constant, U^jy — EfU^y] involves /| Pj |-2| Sj (-f^j'.Jv) with |pj| — 2|sj| > only. Therefore, every i?j,jv 
involved in the expression of — EfU^jy] has rij = \pj \ — 2\sj\ > variables. 

Note that there are no products left at this point in the expression of U^jy — E[U^ 3 jy]. But to compute 

Erj^ =1 (U^ 3 jy — EfU^jy]), one needs to apply the product formula (24) again and then compute the expec- 
tation. Since Wiener-Ito integrals of positive order have mean 0, taking the expectation involves focusing 
on the terms of zero order which are constants. Since / ® p g =< f, g >= EI p (f)I p (g) for functions / and g 
both having p variables, E n/=i C^j'n ~ ^[U^y]) involves only terms of the form: 

H 2 .n) ■ ■ ■ ® tj - 2 Hj- ltN ) (btj^Hj^ (28) 
at) . . . ® tj _ 2 i?j_i iJV ) H JtN dx (29) 

where the contraction size vector t = (t\, . . . , tj-i) runs through some index set. Since these contractions 
must yield a constant, we have 

|t| = ^(m + ... + nj)>0, (30) 

where rij is the number of variables of Hjjq. There is therefore at least one component (call it t) of t which 
is strictly positive and thus there is a pair j\ , 32 with j\ ^ 32 , such that Hj 1 and Hj 2 that have at least one 
common argument. 
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One now needs to show that Gm in (29) tends to 0. This is done by applying the generalized Cauchy- 
Schwartz inequalities in Lemma 2.3 of [14] successively, through the following steps: 

for any j x + h, i\,%2 and r > 0, lim H/h^jv Or /i 2 ,j2,Jv|| = 

for any ji ^ j 2 , i\M and s > 0, lim \\h il , juN <E) S h i2 j 2 . N \\ = 

JV— >oo 

=^> for any 71 7^ j 2 and t > 0, lim \\Hj 1 jv ®t jv || = (31) 
lim Gat = 0, (32) 

JV->oo 

proving (26). 

Finally, if every component of every Uj is moment-determinate, then by Theorem 3 of [18], the distribu- 
tion of U := (Ui, . . . , Uj) is determined by its joint moments. But by (26), the joint moments of U are the 
same as if the Uj's were independent. Then the joint moment-determinancy implies independence. □ 

Corollary 4.1. With the notation of Theorem J^.l, suppose that condition (25) is satisfied and that as 
N — > 00, each Uj,N converges in distribution to some multivariate law which has moment- determinate 
components. Then there are independent random vectors Ui, . . . , Uj such that 

(Ui,j V ,...,Uj, jv )4(Ui,...,Uj). (33) 

Proof. The proof is similar to that of Corollary 3.2 of [14]. Since each U^jv converges in distribution, the 
vector of vectors (Ui,jv, • • • , U^jv) is tight in distribution, so any of its subsequence has a further subsequence 
converging in distribution to a vector (Ui, . . . Uj). But by Theorem 4.1, the Uf's are independent, and the 

convergence in distribution of each U^jv implies that Uj ; jv — > Uj, and hence (33) holds. □ 

We now state the promised extension of Theorem 4.5 of [14]. 
Theorem 4.2. (Extension of Theorem 4-5 in [14]-) Consider 

Sw = (jk 1>s (fl,S,N), ■ ■ ■ ,hj s ,s(fj s ,S,N)j , 
L W = (jk 1>L (/l,L,w), • • • ,hj L>L {fj L ,L,N)j , 

where k Js . s > kj LjL for all j s = 1, . . . , Js and j L = l,...,J L . 

Suppose that as N — > 00, Sn converges in distribution to a multivariate normal law, and Ljv converges 
in distribution to a multivariate law which has moment- determinate components, then there are independent 
random vectors Z and H, such that 

(S N ,L N ) A (Z,H). 

Proof. By Corollary 4.1, we only need to check the contraction condition (25). This is done exactly as in 
the proof of Theorem 4.5 of [14]. For the convenience of the reader, we present the argument here. 

Using the identity ||/ ® r g|| 2 =< / ® p - r f, g ® g _ r g > where r = 1, . . . ,p A q, f and g have respectively 
p and q variables, we get for r = 1, . . . , k^L, 

\\fi,S,N <8>r fj,L,N\\ 2 = < fi,S,N ®k^ s ~r fj,S,N,fj,L,N ®k JiL -r fj,L,N > 

< \\fi,S,N ®fc ilS -r fj,S,N\\\\fj,L,N ®k jtL -r fj,L,N\\ ~> 

because \\fi,s,N <8>fc; s -r fj,S,N\\ —> by the Nualart-Peccati Central Limit Theorem [15], and for the second 
term, one has by Cauchy- Schwartz inequality, \\fj.L,N ®k jtL -r fj,L,N\\ < ||/j,L,iv|| 2 (generalized Cauchy- 
Schwartz inequality (2.15) in [16]), which is bounded due to the tightness of the distribution of Ik jtL (fj,L,N) 
(Lemma 2.1 of [14]). Therefore (25) holds and the conclusion follows from Corollary 4.1. □ 
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5 Proofs of the multivariate convergence results 
5.1 Proof of Theorem 3.1 

We start with a number of lemmas. The first yields the limit covariance structure in (11). 
Lemma 5.1. Assume that ^2 n |7(n)| m < oo, then as N — > oo; 



I>(ni-n2r->(tiAt 2 ) E ^r- 

ni — ln 2 — 1 n— — oo 

Proof. Let a = £i A £2, and b = t\\/ t%, and 

[ATo] [AT a] [AT a] [ATi>] 

^ ^EE ^("i - 5 W , 2 = - £ E ^("i - ^r. 

ni = lri2=l m = l n 2 = [A r a] + l 

so Sn — Sn,i + «5jv,2- We have as TV — > 00, 

[Na]-1 



m=-[Na]+l 

We hence need to show that Sn,2 — > 0. Let c(n) = j(n) m , then 

1 [ATo] [ATb] 1 [ATo] „ 

<SW,2 < E E l C (" 2 _ = 77 E CAf >™i = / fN(u)du, 

m=ln 2 = [JVo]+l «i = l 

where; 

[AT6] — [ATa] 

CAr,ni := E \c([Na]+n 2 -ni)\, 

n 2 = l 

and for u G (0, a), 

[JVa] [ATb-ATa] 

iWfa) := V cw^lp-i^^fu) = 51 |c([JVo]-[JV«]-l + n2)|. 

ni- 1 n 2 — 1 

Now observe that Jn{u) < l c ( n )l < +°° anc ^ tnat wncn AT — > 00 /n{u) — > on (0, a), because 

[JVa] — [iVu] — > 00. Applying the Dominated Convergence Theorem, we deduce Sn,2 — >• 0. □ 

Now we introduce some notations, setting for G G L 2 (cj)), 

, [Art] 

&v, t (G) := 7= E G (^«)- ( 34 ) 
v iv „=i 

The Hermite expansion of each Gj is 

00 

Gj = 5^ g m ,jH m (35) 

m— /cj 

if Gj has Hermite rank kj. Since we are in the pure SRD case, we have as in Remark 2.2, that the auto- 
covariance function 7(71) of {X n } 

00 

\l(n)\ k > < 00, for j = 1, . . . , J. 

n=— 00 

The following lemma states that it suffices to replace a general Gj with a finite linear combination of 
Hermite polynomials: 
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Lemma 5.2. If Theorem 3.1 holds with a finite linear combination of Hermite polynomials Gj = Y^m=kj a m,jH n 
for any M > m.&Xj(kj) and any a m j, then it also holds for any Gj G L 2 (<f>). 

Proof. First we obtain an I? bound for S N , t (H m ). By EH m (X)H m (Y) = mlE{XY) m (Proposition 2.2.1 in 
[13]), for m > 1, 

[Nt] ( [Nt] 

E(S N , t (H m )) 2 = - ®H m (X ni )H m (X n2 ) = ^ 7K-n 2 ) m 

ni,n 2 — l n 1 ,n 2 — 1 

= E [ ^ ' n| 7(") m <^! E I^Hr (36) 

n=l — [JVt] n=-oo 

Next, fix any e > 0. By (36) and ||G||| 2 (0) = J2m=o9rn m ^ f° r M large enough, one has 

M oo 
E|5jv,t(Gj) - SjV,t( ^2 9m,jH m )\ 2 — E| Sjv,t( ^ g m ,]H m )\ 2 
ra—kj m—M+1 
oo oo oo 

= Yl gljHSNAHm)? < t h( n )\ ki E 9 2 m , 3 ml<et. 

m=M+l n =-oc m=M+l 

Therefore, the J-vector 

(M M \ 

<Siv,t( ^ 9m,iH m ), 5jy [t ( g m ,jH m ) J 

m— /ci m—kj / 

satisfies limsup^EHV^MC*) — Vjv(£)| 2 < Jet, and thus 

limlimsupE|Vjv,M(i) - V^i)! 2 = 0. 



M 



N 



By assumption, we have as N — > oo Vjv,m(0 — >' Bju(t) = (Bm,i, ■ ■ ■ , Bm,j), where the multivariate 
Gaussian Bjif(t) has (scaled) Brownian motions as marginals with a covariance structure computed using 
Lemma 5.1 as follows: 



(M M 
<SV,ti( / , gm,j 1 H m )SN,t 2 ( / , gm,j 2 Hrr 
m—kj 1 m—kj 2 

M [N^] [Nt 2 ] 

= J im E 9 m , n g m , j2 ml V V 7(m - n 2 ) m 

m—kj-^ Vkj 2 ni — 1 no — 1 

M oo 

= (*lAfa) X! 9m,ji9m,jM Yl ^M™ 
m=kj 1 \/kj 2 n= — oo 

Furthermore, as M — > oo, Bm(£) tends in f.d.d. to B(t), which is a multivariate Gaussian process with 
the following covariance structure: 

oo oo 

E(B jl (t 1 )B j2 (t 2 )) = (t 1 At 2 ) '■!„..., g „...>..<>'■ E T(«) m - 

m=kj 1 Vkj 2 n— — oc 

Therefore, applying the triangular argument in [2] Theorem 3.2, we have 



V N (t) f ^4- B(t). 



□ 
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The proof of Theorem 3.1 about the pure SRD case relies on [13] Theorem 6.2.3, which says that for 
multiple Wiener-Ito integrals, univariate convergence to normal random variables implies joint convergence 
to a multivariate normal. We state it as follows: 

Lemma 5.3. Let J > 2 and ki,...,kj be some fixed positive integers. Consider vectors 

V w = (V N>1 , . . . , V N .j) := CM/at i), • • -JkAfNj)) 
with Jnj in L 2 (R kj ) . Let C be a symmetric non-negative definite matrix such that 

E(V N ,iV NJ )^C(i,j). 
Then the univariate convergence as N — > oo 

V NJ ±N(0,C(j,j)) j = l,...,J 

implies the joint convergence 

V N A N(0,C). 

We now prove Theorem 3.1. 

Proof. Take time points t\, . . . ,tj, let Vjv(t) be the vector in (2) in the context of Theorem 3.1, with Gj 
replaced by a finite linear combination of Hcrmitc polynomials (Lemma 5.2). Thus 

(M M \ 

~V] A "l' N } s n,u (H m ), ^2 A m (N) SNM ^ Hm " > I ' ^ 
m=fei 1( - ' m=kj ^ ' / 

We want to show the joint convergence 

(V w (ii),., V N (ti)) 4 (B(h), . . . , B(t 7 )) (38) 

with B(£) being the J-dimensional Gaussian process with covariance structure given by (11). 

By (6), and because the term ^ m ^y S n ,u(H m ) involves the m-th order Hermite polynomial only, we can 
represent it as an m-tuple Wiener-Ito integral: 

A ™N) ^ N ' u =: ^rn{fN, m ,i,j) 
for some square- integrable function fN.m.ij- Now 

(m m \ 

I m (fN,m,i,l), ■ ■ ■ , ^2 Im(fN,m,i,j) j (39) 
m—ki m—kj / 

To show (38), one only needs to show that as TV — > oo, (/ m (/jv,m,i,j)) TO i ^ converges jointly to a multi- 
variate normal with the correct covariance structure. 

Note by the univariate SRD result, namely, Theorem 2.1, each I m (fN, m ,i,j) = xffjv) ^Wi (H m ) con- 
verges to a univariate normal. Therefore, by Lemma 5.3, it's sufficient to show the covariance structure of 
{lm(fN,m.i,j)) m i j 1S consistent with the covariance structure of (Bj(ti))i j as N — > oo. 

Note that Aj(N) — o-jN 1 / 2 where Oj is found in (12). If m\ ^ m 2 , 

Elmi (fN,m,ii,ji )Im 2 (/jV,m,i 2 ,j2 ) = - Vmi ' Jl ™ 2 IS {S N , til (H mi )S N , ti2 (H m2 )) = 0. 
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If mi = m 2 = m, 



(fN,m,ii,ji (/jV,m,i2 ,J2 ) 
[JVi 4l ] [JVt i2 ] 

= g m ^,g m j a i j2 Y: E(H m (x ni )H m (x n2 )) 



a h a j2 N 

JL JA n 1 =l n 2 = l 



[Nt H ] [Nt i2 ] 

m.g m!jl ,g mj2 1 ^ ^ 7 ( ni - n 2 ) 



<7 ?1 cr ?2 TV 
Ji J ^ ni=l n 2 =l 



t%1 Atl2 g m , 3l ,g m . l2 m\ V 7(n) m as TV -> oo 
a n a n ^ 



by Lemma 5.1. 

Since every component of Vat in (37) is the sum of multiple Wiener-Ito integrals, it follows that 

t At M °° 

EV Ndl {t h )V Ntj2 (t i2 ) -+ E E 7H m , 

Jl j2 m=kj 1 Vkj 2 n=-oo 

which is the covariance in (11), where here M is finite due to Lemma 5.2. □ 
5.2 Proof of Theorem 3.2 

The pure LRD case is proved by extending the proof in [5] to the multivariate case. Set 

[Nt] 

S Ntt {G) = Y,G{X n ). 

71=1 

The normalization factor which makes the variance at t = 1 tend to 1 is 

Aj (TV) = a j i(iV)^/ 2 iV 1 +^( d - 1 /2) ; (40) 

where the slowly varying function L(N) stems from the auto-covariance function: j(n) = L{n)n 2d ~ x and 
where aj is a normalization constant. 

The Hermite expansion of each Gj is given in 35 The following reduction lemma shows that it suffices to 
replace Gj's with corresponding Hermite polynomials. 

Lemma 5.4. If the convergence in (13) holds with g kj ,jHk j re-placing Gj, then it also holds for Gj, j = 
1,...,J. 

Proof. By the Cramer- Wold device, we want to show for every (wi, . . . , wj) € R J , the following convergence: 

j = l -A ' j = l 

Let G* = gk 3 +i,jH k]+l + gk J +2, 3 H kj+2 + . . ., then 

E SN,t{Gj) _ \^ SN,t{gk 3 ,jH k] ) | ^ SN,t(Gj) 
MN) ~^ Wj Aj (N) + ^ Aj (N) ■ 

By the assumption of this lemma and by the Cramer- Wold device, 

j=l 3\ > j = l 
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Hence it suffices to show that for any t > 0, 

By the elementary inequality: (X)/=i x i) 2 — ^^2j=i x % ^ suffices to show that for each j, 

V Aj(N) J 

This is because the variance growth of G* (sec (7) and (9)) is at most L*([Nt})[Nt}( k J +1 ^ 2d ~^ +2 for some 
slowly varying function L* , while the normalization A 2 (N) = a 2 Lj(N) k ^ N k ^ 2d ~^ +2 tends more rapidly to 
infinity. □ 

The following lemma extends Lemma 3 of [5] to the multivariate case. It states that if Lemma 3 of [5] 
holds in the univariate case in each component, then it holds in the multivariate joint case. 

Lemma 5.5. Let F and Fn be symmetric locally finite Borel measures without atoms on R so that Fn — > F 
weakly. Let Wf n and Wf be complex Hermitian Gaussian measures with control measures Fm and F 
respectively. 

Let Knj be a series of Hermitian(K (— x) = K(x) ) measurable functions of kj variables tending to a 
continuous function Kqj uniformly in any compact set in R fcj as N — > oo. 

Moreover, suppose the following uniform integrability type condition holds for every j = 1, . . . , J: 

lim sup / \K NJ (x)\ 2 F N (dx 1 ),...,F N (dx kj )=0. (41) 

A^ao N Jni k 3\[_A.,A] k 3 

Then we have the joint convergence: 

(/(ffe),...,/!;'^,)) 4 (l£\K 0ll ),...A XKo,j)) • (42) 

where lj^ N \-) denotes a k-tuple Wiener-Ito integral with respect to complex Gaussian random measure Wp N , 
TV = 0,1,2,... 

Proof. By the Cramer- Wold device, we need to show that for every (w\, . . . , wj) <G R J as N — > oo, 

X N := J2 "A? {KnS) 4 X ,o := £ "i = 7 £? (*oj). (43) 
We show first that (43) holds when replacing all kernels with simple Hermitian functions gj of the form: 

n 

g j (u 1 ,...,u kj )= a n,-,t kj 1 A lli] x...xA, ky] (ui,...,U k] ), 
H,...,i fc = l 

where A^j's are bounded Borel sets in R satisfying Fo(dAij) — 0, ai lt ... t i k . = if any two of ii, . . . , i kj are 



equal, and g(u) = g(—u). We claim that 

E^feJ^^^fe). (44) 

3=1 3=1 

Indeed, since Fjv — > Fq weakly and Fo(dAij) = 0, we have as N — > oo: 

EVKfjv (-4t,j)W r F JV (Ak,i) = F N (A hJ n A*,,) -> F (A 4J n i4 fc ,,) = E^^-)^^,,), 
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thus (W FN (A iJ )). J A (W Fo (Aij)) . . jointly . Since Y^ =1 w j I k^ ) (9 3 ) is a polynomial of W FN (A itj ) and by 
Continuous Mapping Theorem, (44) holds. 

Next, due to the atomlessness of Fn, the uniform convergence of Knj to Kqj on any compact set, (41) 
and the continuity of Koj, for any e > 0, there exist simple Hermitian gj's j = 1, . . . , J as above, such that 
for N = and TV > N(e) (large enough), 

/ \K N ,j(xi, . . . ,Xkj) - gj(xi, . . . ,Xfe 3 )| 2 FAr(da;i) . ..F N (dx kj ) < e. (45) 
By (45) for every j = 1, . . . , J, we can find a sequence <?m, j such that 

\\I^{K 0tj )-I^{g Mtj )\\L^<l/M, (46) 

\\I?AK Nij ) - lZ{ gj )\\L* < 1/M for TV > iV(M) (large enough), (47) 



hence by (46) 



and by (47), 



X ,m := E Jg> 4 X ,o := ]T t^lg' (#„) as M ^ oo. (48) 

3=1 3=1 



limlimsupE|JVAr — -Xjv.m | 



m N 



:= lim lim supE 

M N 



3=1 3=1 



2 



= 0. (49) 



Finally, replacing gj by gu,j in (44), we have 



Xn,m — > X 0: m- (50) 
Thus (43), namely, X N 4- X Q:0 , follows now from (48), (49) and (50) and Theorem 3.2 of [2]. □ 
We can now prove Theorem 3.2: 

Proof. Since Lemma 5.5 involves only univariate assumptions and concludes with the desired multivariate 
convergence (42), one needs to treat only the univariate case. This is done in [5]. □ 

5.3 Proof of Theorem 3.3 

Proof. Using the reduction arguments of Lemma 5.2 and Lemma 5.4, we can replace Gj^s in (16) with 
^2 m =k- s 9m,j,sH m , and we can replace Gj t L in (17) with gk L ,j,LHk L , where kj^s > kj t L — 1 or 2 are the cor- 
responding Hermite ranks and g m ,j,Si 9k L -j,L are the corresponding coefficients of their Hermite expansions. 
Fix finite time points t{, i — 1 . . . , /, we need to consider the joint convergence of the following vector: 



( 1 M 1 

{Si,j s ,N,L i> j LtN ).. .:= I X 9m,js,sSN,u(H™)i-. gk L ,j L xS N .tA H k L ) 

\ A is,S m=fe . s S A 3L,L 



where i = 1, . . . , I, j s = 1, . . . , Js, Jl = 1, • • • , Jl- 

As in the proof of Theorem 3.1, using (6), we express Hermite polynomials as multiple Wiener-Ito 
integrals: 

M M 
Si,j s ,N = X] I™(.fm,i,j s ,N), Lij L .N — Im(fm,i,j L ,N), 
m=kj Sl s m=kj Li L 
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where f m ,i,j s ,N, fi,j L ,N are some symmetric square- integrable functions. 

Express the vector in (51) as (Sjv,Ljv), where Sat := (Si,j s ,jv)i,j s , Ljv := (Lij L .N)i,j L - 
By Theorem 3.1, Sn converges in distribution to some multivariate normal distribution, and by The- 
orem 3.2, Ljv converges to a multivariate distribution with moment-determinate marginals, because by 
assumption the limits only involve Hcrmitc rank k = 1 (normal distribution) and k — 2 (Rosenblatt dis- 
tribution). The normal distribution is moment-determinate. The Rosenblatt distribution is also moment- 
determinate because it has analytic characteristic function ([21] p. 301). 

We can now use Theorem 4.2 to conclude the proof. □ 
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